COMPUTER-AIDED LEARNING SYSTEM AND METHOD 



CROSS-REFERENCE TO RELATED APPLICATIONS 

[001] This is a continuation-in-part application of the following co-pending allowed 
U.S. patent applications: 

[002] S/N 08/618,193, filed on March 19, 1996, entitled, Methods and apparatus to 
assess and enhance a student's understanding in a subject (the "Test Application"); 
[003] S/N 08/633,582, filed on April 17, 1996, entitled, Reward enhanced learning 
system and method (the "Reward Application"); 

[004] S/N 08/664,023, filed on May 28, 1996, entitled, Relationship-based computer- 
aided-educational system (the "Relationship Application"); 

[005] S/N 08/675,391, filed on July 2, 1996, entitled, Learning system and method 
based on review (the "Review Application"); and 

[006] S/N 08/707,189, filed on September 3, 1996, entitled, Learning method and 
system that restricts entertainment (the "Restrict Application"). 
[007] All of the above allowed co-pending applications are incorporated by reference 
into this specification. 

BACKGROUND OF THE INVENTION 

[008] The present invention relates generally to learning and more particularly to using 
a computer to enhance learning. 

[009] The foundation of a vibrant society depends on skilled workers. To strengthen 
this foundation, every year the U.S. Government with the private industry have poured 
billions and billions of dollars to improve on learning systems and methods. Money has 
been spent in areas such as laboratory facilities, educational materials, teacher 
recruitment and retention, and others. However, for decades, the way to test a student has 
remained the same; learning has been treated typically as a reward in itself; a fixed 
syllabus usually controls the educational process of a subject without taking into account 
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students' individual progress; what students have learnt are rarely selectively reviewed; 
and typically, the students can access non-educational materials when they should be 
using computers to learn. 

[0010] It should be obvious that we need methods and systems that are based on 
computers to remedy the above deficiencies. 
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SUMMARY OF THE INVENTION 



[0011] In one embodiment, the present invention provides a learning method and system 
that assess and enhance a student's or a user's understanding in a subject. Based on the 
user's understanding, individually-tailored tests are generated, whose difficulties can be 
geared towards the user's level of understanding in the subject. The user not only can use 
the tests to prepare for an examination, but can also use the tests to learn the subject. 
[0012] In another embodiment, the invented method and system are based on the latest 
test results from the latest test taken by the user on the subject, which can be divided into 
line-items. Each line-item covers one area in the subject. In yet another embodiment, at 
least one line-item is more difficult than another line-item. The latest test includes 
questions from different line-items. 

[0013] In one embodiment, the invented system includes a score generator coupled to a 
recommendation generator. In one embodiment, the recommendation generator includes 
an inference engine; and in another embodiment, the recommendation generator includes 
a pre-requisite analyzer. The recommendation generator can be coupled to a report 
generator and a question generator. 

[0014] In one embodiment, the score generator accesses the user's latest test result and 
his prior-to-the-latest test results from a storage medium to generate an overall score for 
each set of questions related to the same line-item. In one embodiment, the prior-to-the- 
latest test results are test results from the test immediately before the latest test. In 
another embodiment, each overall score reflects the user's degree of forgetfulness as a 
function of time for that group of questions. Based on the calculated overall scores, the 
score generator updates information in the storage medium to include the latest test 
results. 

[0015] Both the pre-requisite analyzer and the inference engine in the recommendation 
generator can generate recommendations based on the user's test results. The pre- 
requisite analyzer accesses pre-requisite rules, which, based on the complexity levels of 
the line items, determines a complexity-hierarchy among the line-items. Then, applying 
the complexity-hierarchy to the test results, the pre-requisite analyzer determines the 
user's level of understanding in the subject to provide recommendations for the user 
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which, for example, can be providing suggestions to the user as to the line-item to work 
on. 

[0016] The inference engine accesses a set of relationship rules that define relationship 
among the line items and the subject. Then applying the set of relationship rules to the 
user's test results, the inference engine determines the user's level of understanding in the 
subject to provide recommendations for the user. 

[0017] If there is any conflict among one or more relationship rules with the contents in 
the test results, or if there is any conflict among two or more relationship rules, the 
inference engine can resolve it. Resolving such conflicts helps to ensure a consistent 
assessment of the user's understanding in the subject. 

[0018] In one embodiment, the report generator accesses a report format. Based on the 
recommendations and the report format, the report generator generates a report, which 
can provide assessment of the user's understanding in line-items of the latest test and the 
prior-to-the-latest tests, and which can provide action items to improve on the user's 
understanding in the subject. 

[0019] The question generator, based on the recommendations, generates a number of 
questions, which, in another embodiment, can be categorized into at least two line items- 
one being the one suggested by the recommendations, and the other being different from 
the one suggested by the recommendations. The user can take this new set of questions 
to further enhance his understanding in the subject. 

[0020] In one embodiment, the invented system and method enhance a user's 
understanding in a subject through associating the subject's different areas that the user 
has studied. 

[0021] The subject can be divided into line-items and relationship-items. Each 
relationship-item covers areas that relate two or more items. The items include 
learnt and un-learnt items, with a learnt item being an item that the user has 
achieved a preset level of learning, and with an un-learnt item being an item that 
the user has not yet achieved a preset level of learning. 
[0022] In one embodiment, the recommendation generator also selects and 
classifies the items. That embodiment includes a learning-material generator for 
generating learning materials for the user. 
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[0023] In one embodiment of the invented method, first, the recommendation 
generator selects one un-learnt item. After the selection, the learning-material 
generator generates learning materials for the user to learn the selected item, and 
the system assesses the user's learning progress in the selected item. If the 
assessment on the selected un-learnt item is satisfactory, then the recommendation 
generator classifies one or more relationship-items to be learnt as un-learnt items, 
with each classified relationship-item relating the selected item with one or more 
learnt items. The recommendation generator can also re-classify the selected item 
as a learnt item. Then, another un-learnt item can be selected, which can be a 
line-item, or a relationship-item. The process can continue on until all of the 
items have been learnt. At that point, the user has mastered the subject. 
[0024] There are different ways for the recommendation generator to select an 
un-learnt item. In one embodiment, the recommendation generator selects an un- 
learnt line-item or an un-learnt relationship-item, depending on a value set by an 
instructor. If the un-learnt item is a line-item, the process to select a line-item can 
be based on the difficulty level of the line-item; if the un-learnt item is a 
relationship-item, the selection process can be based on the difficulty level of the 
relationship-item, the time the relationship-item was classified as an un-learnt 
item, and/or whether the user has previously failed to learn the relationship-item. 
[0025] For the learning materials, in one embodiment, the learning material is 
includes questions. In another embodiment, the learning material does not 
include questions. 

[0026] One embodiment of the invented system and method provide users dynamic 
reviews. After a user has learnt certain areas in a subject, summarized learning materials 
on those areas can be selectively generated for the user so as to reinforce the user's 
learning in the subject through reviews. Unlike prior systems, the reviews in the present 
invention can be dynamic; they can be specifically tailored to the needs of individual 
users, or the characteristics of the subject. 

[0027] In one embodiment, the present invention selects an un-learnt item, and generates 
detailed learning materials for it. Then a learnt item is selected, for example, based on 
one or more learnt-item-selection rules, depending on factors such as the time elapsed 
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from the time when the user learnt that item, the level achieved by the user in learning 
that item, its difficulty level, whether that learnt item is related to the selected un-learnt 
item, and whether that learnt item has been selected before. Then, the invention 
generates summarized-learning materials on the selected learnt item for the user to 
review. 

[0028] Different materials are applicable for learning. For example, the summarized- 
learning materials may or may not include questions. 

[0029] For an un-learnt item, after presenting the generated learning material to the user, 
the present invention can assess the user's understanding in the item. If the assessment is 
satisfactory, the un-learnt item can be re-classified as a learnt item. 
[0030] In another embodiment, the present invention accesses an item probability value 
to select an item. If the item is an un-learnt item, the invention can generate detailed 
learning materials for the user; and if the user is successful in learning the materials, the 
invention can re-classify the item as a learnt item. If the item is a learnt item, the 
invention can generate summarized learning materials for the user. The invention then 
can repeat and select another item. 

[0031] In one embodiment, the present invention enriches a user's learning process 
through individualizing rewards. The invention allows an instructor or a user to set when 
and what to reward. The invention also allows a user or the user to delay receiving the 
reward. 

[0032] In one embodiment, the invented system teaches the user a subject. The subject is 
divided into line-items, with at least one line-item being more difficult than another line- 
item. The instructor, such as the user's teacher, guardian or parent, enters his password 
into the invented system. If the password matches the instructor's password stored in the 
system, the instructor has gained access into the system, and can set each line-item where 
there should be a milestone. The system also can provide a list of pre-selected rewards 
for the instructor to pick the reward at each milestone. The list or a part of the list can 
depend on the user's preference. The system can then generate a milestone/reward table, 
capturing the instructor's inputs. 

[0033] In one embodiment, the recommendation generator accesses the table, and 
determines if the user has reached any one of the milestones set by the instructor. This 
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determination process can be accomplished in a number of ways; for example, it can be 
done through one or more rules pre-stored in the system. Such information can then be 
transmitted to a reward determinator. 

[0034] The reward determinator based on the information in the reward table can 
determine the type of reward for the user who has reached a milestone. In one 
embodiment, there are two types of rewards. The first type is a point system, and the 
second type is an actual reward. The user can accumulate points or get an actual reward. 
It would be up to the user to decide. If the user's preference is to pick an actual reward, 
the user can postpone receiving the reward. If the user's preference is to pick the point 
system, his points can be accumulated as he gets more points through reaching more 
milestones. 

[0035] In one embodiment, the report generator accesses the user's preference and the 
milestone reached by the user from the reward determinator. The generator stores the 
milestone-reached in the storage medium, and accesses from the storage medium the 
history of the milestones reached by the user. In one embodiment, based on the accessed 
information, a report is generated every time the user reaches a milestone. In another 
embodiment, the instructor can query the report generator to find out about the user's 
performance. Based on the report, if the user picks points as rewards, then based on the 
accumulated points, rewards can be set by the instructor accordingly. 
[0036] If the user does not want to postpone getting the reward, a reward generator 
generates the reward for the user. Depending on the type of reward, in one embodiment, 
the reward generator accesses the reward from a reward storage medium; and in another 
embodiment, the reward generator accesses the reward from a network. 
[0037] After the user has claimed the reward, the system can ask for the user's feedback 
as to his interest in the reward. This information is also sent to the report generator to be 
presented in the report so that the instructor knows whether she should adjust the rewards 
for future milestones. 

[0038] If the user has postponed receiving his reward and later decides to re-claim it, he 
can enter his password into the system. If the password matches the user's password 
stored in the system, the user can re-claim his postponed rewards. 
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[0039] In one embodiment, the invention provides rewards when the user has 
demonstrated understanding in the subject through tests, not just when the system has 
presented instructional materials. That embodiment requires feedback from the user, 
with rewards reflecting on the user's understanding. 

[0040] In one embodiment, the invented method and system help a user focus on study 
materials by restricting him from freely enjoying entertainment materials on the 
computer. With such an invention, the user is not distracted by entertainment materials 
on the computer when he should be working on the study materials. Even if he wants to 
play, he has to finish studying first. 

[0041] In one embodiment, the entertainment materials are presented through an 
entertainment program, and the study materials are presented through a study program. 
[0042] In one embodiment, the invented system includes an access filter between the 
programs and a device. The entertainment program needs the device to entertain. A 
controller controls the access filter to automatically restrict the coupling between the 
device and the entertainment program, but simultaneously allow the coupling between the 
device and the study program. 

[0043] Different entertainment materials typically require different types of devices to 
entertain. Some examples of devices required by entertainment materials include 
speakers, a position-pointing device such as a joy-stick, an output device, a storage 
medium and a circuit board. The circuit board can be used to couple to video-signals, 
audio-signals or other digital or analog signals. The video-signals can be television 
signals. 

[0044] In one embodiment, the access filter includes a device driver. 
[0045] Under a predetermined condition, the controller removes the restriction 
automatically to allow the device to couple to the entertainment program. This can be 
done through a token system. Under the predetermined condition, the user is given a 
token, which the user can use to remove the restriction. With the restriction removed, the 
user can enjoy the entertainment materials. 

[0046] These predetermined condition can be based on one or more factors, such as the 
amount of time the user has been working on the study materials, the user's performance 
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in the study materials, and the time of day. In one embodiment, one predetermined 
condition is a user has claimed a corresponding reward. 

[0047] Other aspects and advantages of the present invention will become apparent from 
the following detailed description, which, when taken in conjunction with the 
accompanying drawings, illustrates by way of example the principles of the invention. 
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BRIEF DESCRIPTION OF THE DRAWING 

[0048] FIG. 1 illustrates one embodiment of the present invention. However, those 
skilled in the art will readily appreciate that the detailed description given herein with 
respect to the figure is for explanatory purposes as the invention extends beyond these 
limited embodiments. 
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DETAILED DESCRIPTION OF THE INVENTION 



[0049] Figure 1 shows one embodiment of the invention including a super- 
recommendation generator 100 for implementing a computer-aided learning method to 
help a student or a user learn a subject. The generator 100 in general is for enhancing the 
learning experience of the user, and can be implemented in software, firmware, hardware 
or some combination of the above. 

[0050] In one embodiment, the subject can be divided into items, including one or more 
relationship-items, with each relationship-item relating two or more items. The items can 
include learnt and un-learnt items, with a learnt item being an item that the user has 
achieved a preset level of learning, and with an un-learnt item being an item that the user 
has not yet achieved a preset level of learning. 

[0051] In one embodiment, the super-recommendation generator 100 performs a number 
of functions, including the following: 

[0052] assessing a user's understanding in a subject as, for example, described in the Test 
Application; 

[0053] rewarding the user who has reached one or more milestones in the subject as, for 
example, described in the Reward Application; 

[0054] furthering the user's understanding in the subject through relationship learning, as, 
for example, described in the Relationship Application; 

[0055] reinforcing the user's understanding in the subject through reviews, as, for 
example, described in the Review Application; and 

[0056] restricting the user from enjoying entertainment materials under certain condition, 
with the entertainment material requiring a device to fulfill its entertainment purpose, as, 
for example, described in the Restrict Application. 

[0057] One embodiment of the super-recommendation generator is configured to perform 
the following operations: 

[0058] analyzing (102) the user's prior-to-the-latest and the latest test results to 
assess the user's understanding in the subject, as, for example, described in the 
Test Application; 
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[0059] determining (104) whether the user has reached a milestone, as, for 
example, described in the Reward Application; 

[0060] determining a reward (106) for the user that has reached a milestone, with the 
reward depending on the user's preference, as, for example, described in the Reward 
Application; 

[0061] identifying (108) a relationship-item to be learnt, with the identified relationship- 
item relating an item and a learnt item, as, for example, described in the Relationship 
Application; 

[0062] selecting (1 10) a learnt item to be reviewed, as described, for example, in the 
Review Application; and 

[0063] modifying (1 12) an access filter to restrict coupling between the device and the 
entertainment materials, with the restriction removed to allow coupling between the 
device and the entertainment materials under a predetermined condition. 

[0064] In another embodiment, the super-recommendation generator is configured to 
perform only some of the operations, with the subject categorized accordingly. For 
example, the generator 100 is configured not to perform the function of modifying an 
access filter. In another example, the generator 100 is configured to assess (102), identify 
a relationship-item (108) and reinforce through reviews (1 10). In yet another example, 
the generator 100 is configured to perform similar functions as the previous example, 
except for the function of assessment, in which the generator 100 analyzes the user's test 
results using a set of analysis rules to determine the user's understanding level in the 
subject. In a further example, the super-recommendation generator is configured to 
assess (102), determine (104) if the user has reached a milestone, and determine (106) a 
reward; for this example, the subject can be categorized to include one or more milestone. 
[0065] Note that in one embodiment, computer can be defined as a machine that can 
perform a computable function, which can be defined as a function that can be performed 
by a Turing machine or its equivalence. 

[0066] Other embodiments of the invention will be apparent to those skilled in the art 
from a consideration of this specification or practice of the invention disclosed herein. It 
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is intended that the specification and examples be considered as exemplary only, with the 
true scope and spirit of the invention being indicated by the following claims. 
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